16 research outputs found

    CASA: Category-agnostic Skeletal Animal Reconstruction

    Full text link
    Recovering the skeletal shape of an animal from a monocular video is a longstanding challenge. Prevailing animal reconstruction methods often adopt a control-point driven animation model and optimize bone transforms individually without considering skeletal topology, yielding unsatisfactory shape and articulation. In contrast, humans can easily infer the articulation structure of an unknown animal by associating it with a seen articulated character in their memory. Inspired by this fact, we present CASA, a novel Category-Agnostic Skeletal Animal reconstruction method consisting of two major components: a video-to-shape retrieval process and a neural inverse graphics framework. During inference, CASA first retrieves an articulated shape from a 3D character assets bank so that the input video scores highly with the rendered image, according to a pretrained language-vision model. CASA then integrates the retrieved character into an inverse graphics framework and jointly infers the shape deformation, skeleton structure, and skinning weights through optimization. Experiments validate the efficacy of CASA regarding shape reconstruction and articulation. We further demonstrate that the resulting skeletal-animated characters can be used for re-animation.Comment: Accepted to NeurIPS 202

    Occupancy Planes for Single-view RGB-D Human Reconstruction

    Full text link
    Single-view RGB-D human reconstruction with implicit functions is often formulated as per-point classification. Specifically, a set of 3D locations within the view-frustum of the camera are first projected independently onto the image and a corresponding feature is subsequently extracted for each 3D location. The feature of each 3D location is then used to classify independently whether the corresponding 3D point is inside or outside the observed object. This procedure leads to sub-optimal results because correlations between predictions for neighboring locations are only taken into account implicitly via the extracted features. For more accurate results we propose the occupancy planes (OPlanes) representation, which enables to formulate single-view RGB-D human reconstruction as occupancy prediction on planes which slice through the camera's view frustum. Such a representation provides more flexibility than voxel grids and enables to better leverage correlations than per-point classification. On the challenging S3D data we observe a simple classifier based on the OPlanes representation to yield compelling results, especially in difficult situations with partial occlusions due to other objects and partial visibility, which haven't been addressed by prior work

    Degradable mesoporous semimetal antimony nanospheres for near-infrared II multimodal theranostics.

    Get PDF
    Metallic and semimetallic mesoporous frameworks are of great importance owing to their unique properties and broad applications. However, semimetallic mesoporous structures cannot be obtained by the traditional template-mediated strategies due to the inevitable hydrolytic reaction of semimetal compounds. Therefore, it is yet challenging to fabricate mesoporous semimetal nanostructures, not even mention controlling their pore sizes. Here we develop a facile and robust selective etching route to synthesize monodispersed mesoporous antimony nanospheres (MSbNSs). The pore sizes of MSbNSs are tunable by carefully controlling the partial oxidation of Sb nuclei and the selective etching of the as-formed Sb2O3. MSbNSs show a wide absorption from visible to second near-infrared (NIR-II) region. Moreover, PEGylated MSbNSs are degradable and the degradation mechanism is further explained. The NIR-II photothermal performance of MSbNSs is promising with a high photothermal conversion efficiency of ~44% and intensive NIR-II photoacoustic signal. MSbNSs show potential as multifunctional nanomedicines for NIR-II photoacoustic imaging guided synergistic photothermal/chemo therapy in vivo. Our selective etching process would contribute to the development of various semimetallic mesoporous structures and efficient multimodal nanoplatforms for theranostics

    A new species of shrew moles, genus Uropsilus Milne-Edwards, 1871 (Mammalia, Eulipotyphla, Talpidae), from the Wuyi Mountains, Jiangxi Province, eastern China

    Get PDF
    Asian shrew moles, genus Uropsilus, are the most primitive members of family Talpidae. They are distributed mainly in southwestern China and adjacent Bhutan, Myanmar, and Vietnam. In June 2022, we collected five specimens of Uropsilus from Mount Huanggang, Jiangxi Province, eastern China, which is the highest peak of the Wuyi Mountains. We sequenced two mitochondrial (CYT B and 12S rRNA) and three nuclear (PLCB4, RAG1, and RAG2) genes to estimate the phylogenetic relationship of the five shrew moles. We also compared their morphology with recognized species within the genus. Our results show that these specimens collected from Mount Huanggang differ from all named species in Uropsilus. We formally describe the species here as Uropsilus huanggangensis sp. nov. Morphologically, the new species is distinguishable from the other Uropsilus species by the combination of dark chocolate-brown pelage, long snout, enlarged first upper incisor, similarly sized lacrimal and infraorbital foramens, and the curved and sickle-like coronoid process. The genetic distances of the cytochrome b (CYT B) gene between U. huanggangensis and other recognized Uropsilus species ranged between 9.3% and 16.4%. The new species is geographically distant from other species in the genus and is the easternmost record of the Uropsilus. The divergence time of U. huanggangensis was estimated to be the late Pliocene (1.92 Ma, 95% CI = 0.88–2.99)
    corecore